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Abstract — The Kalman filter (KF) and the extended Kalman 
filter (EKF) are well established techniques for state estimation. 
However, the choice of the filter tuning parameters still poses 
a major challenge for the engineers |1|. In the present work, 
two new costs have been proposed for determining the filter 
tuning parameters on the basis of the innovation covariance. 
This provides a cost function based method for the selection 
of suitable combination(s) of filter tuning parameters in order 
to ensure the design of a KF or an EKF having an optimally 
balanced RMSE performance. 

Index Terms — Kalman filter, tuning parameters, innovation 
covariance, cost function 

I. Introduction 

The Kalman filter (KF) and its extension for non-linear 
systems using the linearized system matrices, the extended 
Kalman filter (EKF), are well established techniques for state 
estimation which has important applications in various fields 
like control, monitoring and/or fault detection of various 
systems and processes. Both the KF and the EKF provide 
simple yet effective methods for state estimation by accounting 
for the unmodeled dynamics and measurement noises using the 
system covariance matrices. The Kalman estimation problem 
essentially involves the computation of the Kalman filter gain 
using the estimated system uncertainty and noise covariance 
matrices. However, it is well-known that a major drawback of 
these filters is that they require an apriori knowledge about the 
process and the measurement noise statistics. In most practical 
applications, the exact information about these statistics is 
unavailable and so, these covariance matrices, referred to as 
the filter tuning parameters, have to be supplied by the designer 
using some ad-hoc procedures 0, Q. Thus, the choice of the 



filter tuning parameters still poses a major challenge for the 
engineers fiT l3l. 

Several researchers have tried various methods and ap- 
proaches for choosing the filter tuning parameters to rational- 
ize the ad-hoc nature of the choice. Conventional methods for 
tuning like downhill simplex numerical optimization algorithm 
fH as well as modern techniques like Neural Network (NN), 
genetic algorithm and fuzzy logic based approaches (3, (6J, 
|7 ] have been used for the KF tuning problem. Rosendo et al. 
1 8 ] designed a self-tuned Kalman filter and compared it with 
the conventional running average and a conventionally tuned 
Kalman filter. These filters were used in the low-pass filtering 
stage required in some active power filter algorithms and their 
results showed that though all the three methods perform well, 
but the self-tuned Kalman filter reacts faster under transient 
conditions. A method using the normalization of the system 
matrices has been used for the choice of the covariance matri- 
ces for the online determination of rotor position and speed of 
a permanent-magnet synchronous motor in [ 9 ]. However, none 
of these methods have been able to provide a deterministic 
method for selecting the filter co variances. Some researchers 
have focussed on innovations in order to address the filter 
tuning issue. One method involves the use of the estimated 
autocovariance of the output innovations to compute a least- 
squares estimate of the noise covariance matrices ifTOl . Kailath 
ifTTTl also proposed that the innovations be measured and 
their mean and covariance be approximated using statistical 
methods in order to verify the KF performance and to adjust 
the KF parameters to improve the performance of the state 
estimation. He further stated that if the mean and covariance 
of the innovations are not as expected then it indicates that 



the choice of any or all of the system matrices as well as the 
covariances is/are incorrect. An innovation based cost function 
for KF, termed as the normalized innovation squared (NIS), 
has been suggested in lfl~2l which uses the UMPITS 1 13 ] to find 
out whether the particular choice of the tuning parameters can 
assure convergence of the filter. This cost is defined in terms 
of the innovation q k and the innovation covariance Sk as 

J=^J2lk(S k )- 1 q k (1) 

Under the hypothesis that the filter is consistent, the NIS has 
a chi-square distribution with n z degrees of freedom, where n z 
is the dimension of the measurements. One of the limitations 
of this method is that it has to be tested online and so it cannot 
be used for predictions of suitable choices of the filter tuning 
parameters but can only be used for verification of dimensional 
consistency of the filter. 

In the present paper, a cost function based predictive 
method, for the selection of suitable combination(s) of filter 
tuning parameters, has been proposed in order to ensure 
the design of a Kalman filter having a judiciously balanced 
performance in terms of robustness and sensitivity. For this 
purpose, two novel performance indices (costs) have been 
suggested which can be used to predict and/or compare the 
quality of the practically obtained RMSE performances. In 
Section II, the new performance indices have been derived and 
their significance has been discussed. A realistic problem, used 
to demonstrate the effectiveness of the proposed costs, is stated 
in detail in Section III, while the corresponding simulations 
and results are stated in Section IV. Conclusions are stated in 
Section V. 

II. Novel Performance Indices for the choice of 
Filter Tuning Parameters 

A linear discrete time (stochastic) system may be described 
using linear(ized) state and observation equations, at a partic- 
ular time instant k, as follows: 

Xk+i = F k x k + G k u k + w k 

y k = H k x k + v k (2) 

Here, u k is the known input, while w k and v k are the state 
and measurement noises. Both of these are zero-mean white 
noises with their uncorrelated covariances being Q k and R k 
respectively. F k , G k and H k are the state transition, input and 
measurement matrices respectively. 



The Kalman filter, which estimates the state vector x k from 
the measurements y k in an optimal sense, can be expressed as 
a set of sequential equations for the apriori state estimate and 
error covariance, x^ and P^T, the innovation and its covari- 
ance, q k and S k , the Kalman Gain, K k , and the aposteriori 
state estimate and error covariance x^ and as follows: 





= -Ffe-i#fc_i + Gk-iUk-i 
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For the design of a suitable KF, four tuning parameters need 
to be determined prior to implementing the filter. These are 
the initial state estimate xo and the three uncertainty or noise 
covariance matrices, namely the initial state (estimation) error 
covariance Po, the process (model) noise covariance Q and 
the measurement noise covariance R. Of these covariances, 
Po is only the initial choice of the state estimation error 
covariance P k , which has to be decided by the designers, since 
the state estimation error covariance P k changes as the filtering 
progresses with time and is expected to reach a steady value as 
the filter converges, provided that the system is not subjected 
to any major change in the system input. However, Q and 
R have to be decided for the total duration of filtering and 
depending on practical considerations, designers choose these 
to be time-invariant or time- varying. 

The choice of the elements of xq and Po may range 
from infinitely large values to small values depending on the 
available information about the relevant states fl4l . It has 
further been observed that the choices of xo and Po mainly 
affect the initial part of the estimation so these are usually not 
very critical unless the initial estimation exceeds acceptable 
limits [14]. The choice of R is also non-critical since the 
sensor characteristics, which are usually known beforehand, 
can be used to decide on a suitable matrix. 

Among all the tuning parameters, the tuning of the process 
noise covariance Q is considered to be the most critical Q. 
This is so since all the model uncertainties and inaccuracies 
as well as the noises affecting the process are incorporated 
quantitatively into Q. It is also known that a proper ratio of 



the filter tuning parameter values affects the filter performance 
021, 02) . This further complicates the choice of a suitable Q. 

In the present work, the innovation q k , which directly affects 
the Kalman gain, has been identified as the critical parameter 
which can be utilized to predict the proper choice of Q for the 
filter, given an arbitrary choice of xq, Pq and R, which may 
or may not be identical to the values obtained from the actual 
system. This use of q k can be justified from the established 
fact that the Kalman gain plays a major role in ensuring the 
optimized performance of the KF while the NIS ensures filter 
consistency Q, 0, lfT2l . However, the innovations, which are 
random variables obtained in real-time, are not quite helpful 
for predictions due to lack of a deterministic basis. 

So, in order to obtain a deterministic basis for the prediction 
of the suitable filter tuning parameters, the innovation error 
covariance Sk, as stated in eqn ([6]), is studied instead. It 
is observed that Sk depends on the aposteriori estimation 
error covariance for the measured outputs (not states), namely 
H k P^H^, which can be obtained as follows. 

Starting with the expressions for the apriori state estimation 
error covariance P^ and the Kalman gain K k from eqns ([4]) 
and ([7]) respectively, we obtain 



H k K k = (A + B)(A + B + R k y 1 



(10) 



where A = H k F k _iP^_ 1 F^_ 1 H^ and B = H k Q k _ 1 H%. 

The aposteriori state estimation error covariance P£, as 
stated in eqn ([9]), is pre- and post-multiplied by H k and H% 
respectively, and then pre-multiplied by (A + I?) -1 , where A 
and B are as defined in the previous equation, to obtain 

(A + B)~ 1 [H k {P+ - F^P+^F^Hl] 

= (A + B)~ 1 B -(A + B + R k )~\A + B) 

= (A + B)- 1 B+(A + B + R k )- 1 R k -I m . (11) 

Taking the trace of both sides of eqn ( fTT] i and rearranging, we 
obtain the two new costs J\ k and J<i k as 



Jik + J2k = m-trace{N k } 



(12) 



where 

Jife = trace{(A + B + Rk)- 1 R k } 

J 2k = traceHA + B)-^} 

andiV fe = (A + B)-^[H k (F k - 1 P+_ 1 FT_ 1 -P+)H k r ]. 

It is useful to note from eqn $V2) that the value of J\ k + J 2k 
at any instant k deviates from the number of measurements m 
due to the contribution of the term trace{N k } at that particular 



instant of time k. 

In order to appreciate the significance of the two new costs, 
it must be noted that the focus of the present work is on the 
estimated measurement and the factors contributing to it while 
the standard treatment in the existing literature fT2lL |[T5lL lfT6l 
focuses simply on the estimated states and the errors thereof. 
Here, both the apriori state estimation covariance FkPj^^F^ 
and the process noise covariance Q k -i have been projected 
onto the innovation covariance S k and so, they affect the 
measurement estimate as A and B respectively, as seen from 
eqns ([?]), ^ and ([TO). 

For the evaluation of the overall filter performance, let the 
performance indices or costs J\ and J2 and a controlling 
parameter for the costs, n q , be defined in terms of the total 
horizon N as 
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and n q = log{trace(B)}. 



(13) 



k=i 



In order to evaluate the performances of the KF and the 
EKF, the four filter tuning parameters xo,Pq,R may be 
fixed apriori, as stated earlier in this Section, while Qo is 
continuously varied. A change in Qo changes the overall 
n q , irrespective of the choice of a fixed or variable Q k . 
Furthermore, this change in Qo affects the general tuning 
parameter ratios P/Q and Q/R at all instants and for all 
the states. As stated in (T2), these affect the overall filter 
performances. 



The following are observed from eqn ( [13] ) for a changing 
Qo, and hence a changing n q . 

(i) For very large Qq, B is much larger than R in terms of 
the trace, and so, J\ tends to 0. 

Also in this case, J2 tends to the number of measurements 
m for a convergent and small A. 

(ii) Similarly, when Qo is small, B is significantly smaller 
than R in terms of the trace, then J\ — » m and reaches 
a steady value. 



(iii) When B is comparable to R in terms of the trace, then 
Ji and J2 change significantly from both the upper and 
lower bounds stated earlier. 

III. Case Study 

In order to verify the predictability of the performance of 
a filter for different combinations of the tuning parameters 
using the defined costs J\ and J2, the problem considered in 
the present work is that of the tracking of a 2D ballistic target 
as discussed in ifTTl . It is assumed that the object enters the 
atmosphere in reentry phase under the presence of nonlinear 
air drag as well as gravity and so, the trajectory of the target 
is a nonlinear one. 

The equivalent discrete-time target motion can be expressed 
using the nonlinear state equation IfTTl 



x k +i = f(x k ) + Gu k + w k 

= Fx k + Gf kk (x k ) + Gu k 



(14) 



where the state vector x k = [x\ k x\ k X2 k X2 k ] T consists of the 
positions in the x and y directions denoted as x\ k and X2 k re- 
spectively and their corresponding velocities. u k = [0 (— g)] T 
and w k = iV(0, y/Qt) are the input matrix and the process 
noise respectively. 



The function f kk (x k ) 
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The measurement equation is considered to be 

ymk = h(x k ) + v k (15) 

where the terms have their usual meaning and the measurement 
noise is considered to be v k — Af(0, \JRa). 
In the practical scenario, the measurements available depend 
on the choice of the sensor(s) and other practical constraints. 
In order to obtain the measurements of the positions Xi m and 
X2m, the simulated radar measurements of range r and angle 
e, available in polar co-ordinates, are converted into Cartesian 
coordinates. The relations used are x\ m = rcos(e) and X2 m = 
rsin(e). These data are further corrupted with the randomly 
generated zero-mean measurement noise v k using the noise 
covariance matrix Ra given as 



Ra 



a d a dh 



(16) 



where 



-I 

and a dh 



= a 2 cos 2 (e) + r 2 <j 2 sin 2 (e) 
= a 2 . sin 2 (e) + r 2 a 2 cos 2 (e) 
— (a 2 — r 2 a 2 ) sin(e) cos(e) 



These and all other terms, as used in the present problem, 
are as defined in IfTTl . Only, the target ballistic co-efficient 
/? has been assumed to be known with a constant value of 
j3 = 40000/cgra -1 s -2 . The acceleration due to gravity g is 
assumed to be constant at 9. 81ms - 2 . 

The ballistic target trajectory has been generated 
considering the initial value of the state vector as xo = 
[232km 2.29cos(190°)kms- 1 88km 2.29sin(190°)kms- 1 ] T 
and the air density function p = C\e~ C2X2 with 
d = 1.227, C 2 = 1.093 x 10- 4 when x 2 < 9.144/cra 
and Ci = 1.754, C 2 = 1.490 x 10~ 4 when x 2 > 9.144/cra. 
This change in the air density during the reentry becomes 
very crucial during the estimation as the system nonlinearity 
changes abruptly at this height. 



such that cr r — 100m is the variance of r and cr e = 
(.017/57.3)° is the variance of e. 

IV. Simulation and Results 

In order to evaluate the performances of the KF and the 
EKF, the four filter tuning parameters xo , Pq~ , R and a nominal 
Qo, henceforth referred to as Q n0 m, have to be fixed. In this 
case, xq and P + are obtained using the two point differencing 
method as stated in lfT2l and IfTTl . R is obtained from the 
sensor and is considered to be time-invariant while Q n0 m is 
obtained as the adaptive Q as discussed in [3]. The values of 
these tuning parameters, which are considered to be the same 
for both KF and EKF, are as follows: 

2.25 x 10 5 
-2.81 x 10 3 

9.26 x 10 4 
6.75 x 10 3 



xo 



R = 



10.54 
-3.85 



-3.85 
37.15 



TABLE I 

Costs Ji and J 2 for KF and EKF 



2.48 x 10 6 


-6.76 x 10 6 






1.24 x 10 6 


-0.73 x 10 6 



-6.76 x 10 6 


1.47 x 10 7 






-1.73 x 10 6 


7.34 x 10 6 



2.48 x 10 5 
6.32 x 10 4 
-5.10 x 10 5 
-1.04 x 10 5 



6.32 x 10 4 
2.34 x 10 4 
-1.04 x 10 5 
-2.88 x 10 4 



-5.10 x 10 5 
-1.04 x 10 5 

1.44 x 10 6 

3.45 x 10 5 



-1.04 x 10 5 
-2.88 x 10 4 
3.45 x 10 5 
1.20 x 10 5 



In order to predict the performances of the KF and the EKF 
and compare them for different combinations of the tuning 
parameters, the costs J\ and J 2 have been obtained for varying 
n q as shown in Fig[T]and Table [i] by using Qo = lO p Q nom , 
and varying p suitably, as evident from the first two columns of 
the Table. These predictive costs have been compared with the 
RMSE performances of the KF, (Fig(2]), and the EKF, (Fig(3]), 
obtained using the same tuning parameters. 
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value close to m for low n q while J2 also reaches a 
steady maximum value close to m, but for high n q . In 
this case, it is observed that J\ attains a steady value of 
1.51, for KF as well as EKF, for values of n q less than 
—4.79 and —3.79 respectively while J 2 attains a steady 
value of 1.72 and 1.73 for KF and EKF respectively, 
for n q larger than 9.21 in both the cases. A minimum 
value, very close to 0, is obtained for J 2 when n q is 
very small, typically -2.79 or less, and for Ji, when n q 
is very large, typically 4.21 or more, for both KF and 
EKF. 



Fig. 1. Plots of J 1 and J 2 vs. n q for KF and EKF 

As can be predicted from the derivations, it is observed 
from Fig[T] and Table [I] that, for changing Qo and hence, for 
changing n q , 

1) Both J 1 and J 2 are bounded by the number of 
measurements m = 2 in the upper limit and in the 
lower limit for significantly high and low values of n q . 
As n q changes, the values of both J\ and J2 change 
between these limits of m and 0. 

2) While Pq and R are fixed, J\ attains a steady maximum 



3) At a particular value of n q , with the corresponding value 
of Qo henceforth referred to as the compromise value, 
Qcomp, there is a crossover of the plots for J\ and J 2. 
In this case, the corresponding value of n q for Q CO mp 
lies between 0.21 and 1.21 for both KF and EKF. 

4) The filter exhibits robustness for those combinations 
of the tuning parameters for which the value of J2 is 
close to the number of measurements m. On the other 
hand, when the value of J\ is close to the number 
of measurements, this indicates a sensitivity in the 
RMSE performance but this might also cause the filter 
to diverge if the actual system noise or disturbances 



are large. Hence, it can be said that the robustness of 
the RMSE performances increase for KF and EKF for 
n q > 1.21 while sensitivity of the RMSE performances 
of the filters increase for n q < 1. This is validated from 
the filter performances as observed in Figs. [2] and [3] 



5) Identical values of the costs obtained using the same 
filter indicate similarity of the RMSE performances. 
From the RMSE plots for KF (Fig(2]) and EKF (Figj3j, it 
is observed that similar robust performances are obtained 
for n q > 4.21 while similar sensitive performances are 
obtained for n q < (—4.79). For the KF filter, the position 
estimates show lower RMSE but with a tendency of 
divergence during the end phase whereas the velocity 
estimates have additional initial spikes in the sensitive 
zone of n q while the RMSE performances in this zone 
are much improved in the case of the EKF. However, it 
is interesting to note that the performances of both the 
KF and the EKF filters are quite similar in the robust 
zone. It is also observed that at n q = 7.21, the cost J 2 
for both the filters shows a high spike, with values of 
1.75 and 1.76 for KF and EKF respectively. From the 
RMSE plots, it is observed that this corresponds to high 
initial peaks in the position estimates in both filters. 

6) In the zone where the values of J\ and J2 are changing 
and specifically near the crossover point, the trade-off 
between sensitiveness and robustness of the filter can 
be achieved with a judicious choice of the combination 
of the tuning parameters. A non-judicious choice may 
lead to filter instability. So, the best compromise in the 
RMSE performances is expected near Qo = Qcomp- This 
is validated from the RMSE plots for both filters for 
0.21 < n q < 1.21, where there are no sharp peaks in 
the initial phase nor is there any divergent behaviour at 
the end phase. 

V. Conclusion 

In the present work, two new costs J\ and J2 have been 
proposed for determining the filter tuning parameters on the 
basis of the innovation covariance Sk by using the concept 
of the estimated measurement and the factors contributing to 
it. It is to be noted that the standard treatment in the existing 
literature 021, fT5lL fT6l focuses simply on the estimated states 
and the errors thereof. So, the proposed approach provides a 



major shift in the filtering paradigm. 

For predicting the proper combination of the filter tuning 
parameters, these performance indices have been evaluated for 
a 2D ballistic target problem [ 17 ] as shown in Fig[T]and Table 
[I] For this, the critical tuning parameter Q d, and hence, a 



new controlling parameter n q , as defined in eqn. (13), has 
been varied by considering Qo = lO p Q nom where Q n0 m is 
a nominal Q matrix and the multiplier p is varied suitably. 
All the other filter tuning parameters, xq, P + and R, are kept 
fixed. The predictions from the costs J\ and J2, have been 
validated in terms of the RMSE performances for KF (Fig|2]) 
and EKF (Fig [3} and are summarized hereafter. 

It is observed that both J\ and J2 are bounded by the 
number of measurements m = 2 in the upper limit and 
in the lower limit for significantly high and low values of n q . 
As n q changes, the values of both J\ and J 2 change between 
these limits of m and 0. While Pq and R are fixed, J\ attains a 
steady maximum value close to m for low n q while J2 reaches 
a maximum value close to m for high n q . A minimum value, 
very close to 0, is obtained for J2 when n q is very small and 
for Ji, when n q is very large, for both KF and EKF. 

At a particular value of n q , with the corresponding value of 
Qo henceforth referred to as the compromise value, Q 

comp-> 

there is a crossover of the plots for J\ and J2. In this case, 
the corresponding value of n q for Q CO mp lies between 0.21 
and 1.21 for both KF and EKF. A value of J 2 close to the 
number of measurements m indicates that the filter exhibits 
robustness for those combinations of the tuning parameters. 
On the other hand, when the value of J\ is close to the 
number of measurements, this indicates a sensitivity in the 
RMSE performance but this might also cause the filter to 
diverge. Hence, robustness of the RMSE performances are 
expected and obtained for KF and EKF for n q > 1.21 while 
sensitivity of performances of the filters increase for n q < 1. 
However, there is a limit to both of these since identical costs 
for the same filter yields identical RMSE performances. So, the 
proposed costs J\ and J2 can be used by the design engineer 
to decide suitable choices of the filter tuning parameters based 
on the performance requirements for the system. 

Further studies have been and are being performed by the 
present researchers using these predictive costs for different 
linear and nonlinear system and measurement scenarios which 
validate the observations stated in this work. These also 
provide additional insight into the choice of the filter tuning 
parameters and their effects on the RMSE performances. 
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Fig. 2. RMSE plots of the positions a)x and b)y and velocities c)V x and Fig. 3. RMSE plots of the positions a)x and b)y and velocities c)V x and 
d)V y using KF d)V y using EKF 



